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Abstract 

The problem of maximizing a non-negative submodular function was introduced by Feige, Mirrokni, 
and Vondrak [FOCS’07] who provided a deterministic local-search based algorithm that guarantees an 
approximation ratio of as well as a randomized |-approximation algorithm. An extensive line of 
research followed and various algorithms with improving approximation ratios were developed, all of 
them are randomized. Finally, Buchbinder et al. [FOCS’12] presented a randomized /-approximation 
algorithm, which is the best possible. 

This paper gives the first deterministic algorithm for maximizing a non-negative submodular function 
that achieves an approximation ratio better than 1. The approximation ratio of our algorithm is |. Our 
algorithm is based on recursive composition of solutions obtained by the local search algorithm of Feige 
et al. We show that the | approximation ratio can be guaranteed when the recursion depth is 2, and leave 
open the question of whether the approximation ratio improves as the recursion depth increases. 


1 Introduction 

Let / : 2 m — > R be a set function on a ground set M of elements (|M| = m). We say that / is submodular 
if it exhibits decreasing marginal utilities. In other words, For every two sets S and T such that S CT C M 
and element j G M: 

An equivalent definition is that for every two subsets S and T it holds that: 

f(S) + f(T) > f(S U T) + f(S n T) 

It is common to assume that / is non-negative: that is, for every S C M, f(S) > 0. 

Submodular functions arise in many combinatorial optimization scenarios. For example, given a graph 
G = (V, E), let the cut function of G : 2 V M be the function that assigns every subset of the vertices S 
the size of the cut (S, V — S ). Observe that a cut function is submodular. Similarly, the objective function in 
classic problems such as SET-COVER is also submodular. The decreasing marginal utilities property also 
makes submodular functions a popular object of study in various economic settings, such as combinatorial 
auctions and influence maximization in social networks (see, e.g., |[8l and Q, respectively). 

The formal study of approximation algorithm^ for submodular optimization problems has started back 
in 1978: Nemhauser, Wolsey and Fisher Q showed that for monotone and non-negative submodular func¬ 
tions, a natural greedy algorithm gives a (1 — 1/e)-approximation to monotone submodular maximization 
under a cardinality constraint. 

'in general representing a submodular function / takes space that is exponential in m. Therefore, we assume that / is accessed 
via value queries: given S, what is f(S)7 All the algorithms we mention make poly(m) value queries and run in time poly(m). 
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However, the objective function of problems like MAX—CUT is submodular but not necessarily mono¬ 
tone so the above algorithm does not guarantee any bounded approximation ratio. To handle this lacuna, 
Feige et al. 01 initiated the study of algorithms for maximizing non-negative submodular functions. They 
developed a local search algorithm that finds a set whose value is at least | of the value of the maximum- 
value set. In addition, they presented a randomized l -approximation. Their algorithms are complemented 
by the following hardness result: any algorithm that obtains a better approximation ratio than must make 
exponentially (in m) many queries. This hardness result was later extended O: unless NP = RP, no \ + e 
polynomial time approximation algorithm exists. 

Subsequent work led to improvements in the approximation ratio. Oveis Gharan and Vondrak showed 
a randomized 0.41-approximation algorithm (6j. Feldman et al. 0 improved this to 0.42, again using 
a randomized algorithm. Finally, Buchbinder, Feldman, Naor and Schwartz (l] presented a randomized 
algorithm that achieves an approximation ratio of i, which as mentioned above, is the best possible. 

However, there was no progress at all regarding the approximation ratio achievable by deterministic 
algorithms, and prior to our work no deterministic algorithm was known to obtain a ratio better than 
Indeed, this open question was recently mentioned, e.g., by |-4j|. Our paper makes progress on this front: 

Theorem 1.1. For every e > 0 there is a deterministic algorithm that provides a (| — e) -approximation to 
unconstrained submodular maximization and makes O (j ■ m • log rri) value queries. 

Our algorithm can be seen as a recursive composition of solutions obtained by the local search algorithm 
of Q. Here is a sketch of our algorithm (see the technical sections for a more accurate description): 

1. Find a local maximurrH S. 

2. Use an approximation algorithm to obtain Tj with high value when / is restricted to S c . El 

3. Use an approximation algorithm to obtain T 2 C S such that / (S c U T 2 ) is high. 

4. Return arg max {S, S c , Tj U To}. 

For the base case we use in Steps [2] and [3] the local search algorithm of (7]|. After obtaining an algorithm 
with an improved approximation ratio, this new algorithm can be used recursively in Steps [2] and [3] We 
will show that when the recursion depth is 2 the approximation ratio is |. The approximation ratio of the 
algorithm should in principle improve as the recursion depth increases, but we do not know how to analyze 
it. This is the main open question that this paper leaves. 

2 A ^-Approximation Algorithm 

In this section we prove that there exists a |-approximation algorithm to the problem of maximizing a non¬ 
negative submodular function. To gain some intuition about our algorithm we will see how one can get a 
better than ^-approximation (Subsection 12. II ). We will then give a formal description and analysis of our 
algorithm (Subsection 12. 2l onwards). 

2.1 Warm-Up: Improving over the |-Approximation Factor 

We now show that we can get an approximation ratio better than | approximation. Let S' be a local maximum 

S. Feige et al. 0 show that 2/ (S) + / (S c ) > / (OPT), which implies that either S or S c provides a 

2 S is a local maximum if f(S) > f(S U T) and f(S) > f(S — T) for all T. 

3 We use the notation S c to denote the complement set of S. 
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I approximation (we let OPT denote the optimal solution). In fact, a slightly stronger inequality holds: 

2/ (S) + f (S c ) > f (OPT) + / (M) + / (0). 

Consider a scenario in which the local-maximum algorithm returns only a | approximation. In that case 
we have / (S) = 02101 and / ( S c ) = We will show that two other sets, S c U OPT and S c nOPT 

have high value. For the first set, observe that (using submodularity for the first inequality, S being a local 
maximum for the second, and f(S) = T ^ for the third one): 

/ ( S c U OPT ) > f (OPT) + / (M) - / (OPT U S) (1) 

> / (OPT) + / (M) - f (S) 

> 2/ (OPT) 
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Similarly / (S c D OPT) > 'PAPTll. j n other words: 

1. There is a subset of S c with high value. In particular - , the value is at least 2 f(S c ). 

2. There is a superset of S c with high value. In particular, the value is at least 2 f(S c ). 

Now we would like to (approximately) find these subsets. Observe that we actually have a (smaller) sub- 
modular maximization problem. To see this, let M\ = S c and /i : 2 Ml —> K be the submodular function 
fi(T) = f(T) for every T C M\. Observe that f(S c ) = f (Ml) = IP2TH. i n addition, we have already 
seen that /( OPTm x ) > IPTTZA, where OPTm x is a maximum value set of f\. 

We now run the local search algorithm on the the function f\ and find a local maximum T\ C S c . By 
the properties of a local maximum we are guaranteed that 

2/ (Ti) + / (Mi -Ti)>f 0 OPT Mx ) + / (Mr) + / (0) 

Notice that by our bounds for / (OPTm 1 ) and /(Mi) it must be that /(Ti) > 1 or that /(Mi — Ti) > 

f(OPT) ' j|- Qne () j- th em has higher value we already reach an approximation ratio better than Flence, we 

assume that / (Ti) = /(0 f r) , then / (M, - T x ) = /( ° 3 PT) . 

We now repeat a similar argument. Similarly to inequality £[]), 

f(OPT) 

f ((Mi - Ti) U OPT Ml ) > / (OPT Ml ) + f (Mi) - / (Ti) > 1 - } - (2) 

Let M( = Tt. Let f[ : 2 M < -p M be the submodular function where /[ (T) = f(T U (Mi — Ti) for 
every T C M(. Observe that f[ (M[) = an d f( (0) = . Furthermore, by inequality © the 

maximum value of f( is at least L e t T( be a local maximum of f\. Using Q again we have that: 

max(/(T(), f(M[ - T{)) >±(f (Mi -Ti) + f (Mi) + / (OPT Ml U (Mi - Ti))) > ^ • f(OPT) 

This already establishes that the approximation ratio is better than i, but we can do even better: find T 2 C S 
such that / (S c U To) has high value. Combine Ti and T 2 to sum the improvements, since submodularity 
implies that / (Ti U T 2 ) > / (S c ) + (/ (Ti) - / (S c )) + (f (S c U T 2 ) - f (S c )). 

2.2 The Algorithm 

We now present our main result: an improved deterministic algorithm for maximizing a submodular func¬ 
tion. As discussed earlier, our algorithm will be based on repeatedly finding local maxima of different 
subsets and combining the result. Flowever, we do not know how to find a local maximum with a polyno¬ 
mial number of value queries, thus we have to settle on approximate solutions: 
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Definition 2.1. Fix a function f : 2 M —> M. S is a (1 + e) — local maximum of f if for every T C M: 

1. (l + e)/(5) > f(SUT). 

2. (1 + e) / (5) > f (S C T). 

We will use algorithms from 0 and fU for our “base case”. 

Theorem 2.2 (essentially lEHEJ). There is an algorithm LMS e that gets as a input function f, a set of 
elements M and e and returns a set S that is (1 + e) — approximate local maximum. In addition, f(S) > 
/(OPT) , w / lere opt j s f] ie se i w i[h p ie highest value. The algorithm makes O ( j ■ m 2 ■ log m) value queries. 

Feige et al 0 show how to start with a set T and find a set S that is a (1 + e)-approximate local 
maximum with O (| • m 2 ■ log m) value queries. Their algorithm guarantees that f(S) > /(T) and that 
either f(S ) > ^ 3 ( 1 +^ or This weaker guarantee suffices to our analysis, but it would be 

simpler to first obtain a set T with f(T) > via the deterministic algorithm of |[Tj], and then obtain 

an approximate local maximum S by running the algorithm of |f3]] with T as the initial set. 

We are now ready to present our recursive algorithm for unconstrained submodular maximization. The 
input is a submodular function / defined on a set of elements M, and a parameter nrounds that determines 
the recursion depth. We also assume some fixed accuracy parameter e > 0. The algorithm returns a set that 
will be proved to provide a high value. 

USM e (/, M, nrounds) : 

1. Define /': /' (T) = / (T) - min (/ (0), / (M)). Let 5 = LMS e (/', M). 

2. If S = M, 5 = 0, or nrounds = 0 then return 5. 

3. Let Mi = S c , define f p /1 (T) = f (T). Let T x = USM e (/,, M x , nrounds - 1). 

4. Let M 2 = 5, define / 2 : / 2 (T) = f (5 C U T). Let T 2 = USM e (/ 2 , M 2 , nrounds - 1). 

5. Return argmax Re{Si(TlUT2))Mj0} / (. R ). 

Theorem 2.3. Let f(USM e (/, M, 2)) > (| —e)-f{OPT). Moreover, the algorithm makes O Q • m 2 ■ logm) 
value queries in this case. 

2.3 Proof of Theorem 12.31 

We first analyze the running time of the algorithm. Let L e (m) be the maximum number of queries LMS e 
makes on any submodular function that is defined on m elements. 

Lemma 2.4. For every integer n > 0 the number of queries used by USM e (/, M, n) is O (rn ■ L e (m)). As 
a corollary, for every integer n > 0 the number of queries used by USM e (/, M, n) is O ( - • m 3 log rn). 

Proof. Denote by T e ( k) the maximal number of queries USM e makes on a submodular function with 
\M\ = k. In iterations where the algorithm stops at Step|2j the number of queries is at most L e (\M\). Else, 
we have that \M\ > |5| > 0. The algorithm then recursively solves two subproblems, one on 5 and the 
other on S c . Thus, T e ( m) can be bounded by: 

T e (m) < max ( T e (d) + T e (m — d)) + L e (m) 

d=l..m—l 

Solving that recursion by induction on m gives that T f {rn) < L e (m) • m. □ 
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The next lemma bounds the approximation ratio when the recursion depth is 2 (i.e., nrounds = 2). We 
note that using a larger value of nrounds should in principle yield an improved ratio, but currently we are 
unable to formally analyze this case. The next subsections are devoted to proving the lemma. 

Lemma 2.5. For every e > 0 and for every submodular function f with f (M) > 0 and f (0) > 0: 

~ f (OPT) 


f (USM e (f,M, 2)) > 0 


2.4 Proof Overview 

We introduce a function a* which represents a lower bound on the value of the solution that the algorithm 
outputs after i rounds. Let T be the set of all submodular functions. 

Definition 2.6. afixoPT, x 0 , x M ) = inf jpp {USM e (/, M, i) \f (OPT) > x 0 pt, f ( 0 ) > x 0 , f (M) > x M }. 

Our result is based on the following lower bounds for The proofs are in Subsection 12. 5 1 

Claim 2.7. For every non negative xopt, xq,xm-' 

ao(xoPT , xo, xm) > max(^ (xopt + x 0 + xm) , xm, xq) 

Claim 2.8 (composition lemma). Let f be a submodular function, i > 0, and S, T\ and T 2 are the sets 
defined in the algorithm when we run USM e (f, M, i). Then, 

f (T\ U Tf) > a i . 1 (f(OPT) + fm-(l + e)f(S),fm,f(S c )) + 

oh -t (/ (OPT) + / (M) — (1 + e) / (S ), / (S c ), / (M)) - f (S c ) 

And in particular: 

f (Ti U T 2 ) > ai _! (/ (OPT) + / (M) - (1 + e)f(S),f (S c ) , / (M)) 

Claim 2.9. For every non negative xqpt, x m, -X'o we have: 


oti(xoPT , 0, xm) 

1 — e 1 — e 

> max( • xqpt + „ 

' XM, Xo) 

Oil(xoPT , Xo, 0) 

1—6 

1 — 6 

■ x 0 ,x 0 ) 

> max - 

v 3 

• xqpt+ 2 


Before proving these two claims, let us see why they let us derive our main bound on the quality of the 
solution (note that lemma [231 can be directly derived from this claim): 

Claim 2.10. For every non negative xqpt, •Tvf we have: 


Ot2(xQPT , 0 , 0 ) > 



XOPT 


Proof. Let / be a submodular function such that / (OPT) > xopt, f ( 0 ) 
to show that: 


USM e (f,M, 2) > (-- e )f(OPT) 


> 0 and / (M) > 0. We want 
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Let T\, T 2 be the sets defined by the algorithm when we run USM e (/, M, 2). Using the composition lemma 
we know that: 


/ m U T 2 ) > ai (f (OPT) - (1 + e) / (S), 0, f (S c )) + «! (f (OPT) - (1 + e) f (S), f (S c ) , 0) - / (S c ) 

We use claim 12. 9l to bound aq and get: 

f(TiUT 2 ) > 2(l-e) Q[/ (OPT)- (1 + e) f (5)] + ^/(S c )) - f (S c ) 

= | (1 - e) / (OPT) - | (1 - e 2 ) / (5) - e/ (P c ) 

> |(1 -e)f(OPT)-lf(S)-ef(OPT) 

= l(f(OPT)-f(S))- b -ef(OPT) 

The algorithm compares / (T\ U T 2 ) to / (S) and returns the set with highest value. Therefore, 

USM e (/, M, 2) > max (f (S) , |/ (OPT) - |/ (5) - |e/ (OPT)) 

That is a maximum of two functions, both linear in / (S'), one is ascending and one is descending. The 
minimum of a maximum of two such functions is achieved at their intersection. I.e., when / (S) = | • 

/ (OPT) — \ - f (S) — | • e • / (OPT). Solving this equation gives us: 


USM e (/, M, 2) > (- — e)/ (OPT) 


By the definition of 0:2 and since / (OPT) > xqpt, 


«2 ( xqpTi 0,0) > ( — — e ) xqpt 


□ 


2.5 Proofs 

To finish the proof of our main result all we are left with is proving the bounds for 0:0 and a± (claims 12.71 
12.91) and the composition lemma (claim lT8l) . We start with some helpful observations. 


2.5.1 Observations 

Let S be a (1 + e)-local maximum. Therefore: 


(l + e)f(S)>f(SDOPT) (3) 

(l + e)f(S)>f(SuOPT) (4) 

Also, submodularity of / implies that 

/ (opt n s c ) + f (opt n s)>f (opt) + / (0) (5) 

/ (OPT U S c ) + f (OPT U S) > f (OPT) + f (M) (6) 

The next claim appeared in @ in a slightly different form: 
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Claim 2.11. Let S be a (1 + e)-local maximum, and f a submodular function. Then 2 (1 + e) / (S) + 
/ (S c ) > / (OPT) + / (M) + / (0). 

Proof. Since / is submodular, 

/ (S c ) + f ( OPT U S)>f ( OPT n S c ) + f (M ). 

Inequalities ©, ©, © together with the above inequality gives us: 


2(1 + e )f(S) + f(S c ) 


> f(s n opt ) + / (s u opt ) + / (s c ) 

> f(S U OPT ) + / (OPT n S c ) + f (M) 

> f (OPT) + f (0) + / (M) 


□ 


2.5.2 Proof of Claim (2/71 

Let / be a submodular function, and S be the local maximum found by the algorithm. Using theorem [2.21 


3/ (S) > f (OPT) + f(M) + f (0) 

Also, note that the algorithm takes the set with highest value among S, S c , M and 0. Therefore, for 
every submodular /: 


USM e (/, M, 0) > max ( / (0), / (M ), 1 (/ (OPT) + f (M) + f 


Hence, by the definition of ao, 


a 0 > max ( x a , x M , ^ (xqpt + x 0 + x M ) 


2.5.3 Proof of Claim I2T81 (composition lemma) 

We follow steps[3]and[4]of the algorithm. The algorithm takes the set S c and attempts to improve it by adding 
some elements and removing others. Since / is submodular and T\ C ,S"', then / (T 2 IT 1 ) > / (TfSf. 
Therefore: 


/ (Ti U T 2 ) = f (Ti) + / (T 2 |Ti) > / (TO + / (T 2 |5 c ) = h (T ± ) + f 2 (T 2 ) - / (P c ) (7) 
Next, we give bounds on f\ (Tf) and / 2 (T 2 ): 

Claim 2.12. T/;c above T\ and T 2 satisfy: 

fi(Ti) > oii-i (f (OPT) + / ( 0 ) — / ( 5 1 ), / ( 0 ), / ( 5 ,c )) 

/ 2 (T 2 ) > a i . 1 ((f(OPT) + f(M)-f(S),f(S c ),f(M)) 

Proof First, note that by the definition of a*, it is monotone in the following sense: if xopt > Uopt, 
xo > Vo and x M > Um, then ( xqpt , at 0 , x M ) > a* (yopr, 2/o, 2 /m)- 
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Consider the subproblems in which we attempt to find a maximum of A and A- By the definition of 
CKi_i, we have: 


A (Ti) = USM e (A, AAA - 1) > (max (A (P )), A (0), A (Ml)) (8) 

A (A) = [ASM, (A, M 2 ,i - 1) > a ? ;_! (max (/ 2 (P)), / 2 (0) , / 2 (M 2 )) (9) 

Combining © and © gives us A (OPT n 5 C ) > / (OPT) + / (0) — (1 + e) / (S'). Therefore, 
maxRcse A (P) > A (OPT D 5 C ) > / (OPT) + / (0) - (1 + e) / (5). Note also that A (0) = / (0) and 
A (Mi) = / (S' c ). Applying inequality © and using the monotonicity of a*, we have: 

A (A) > a*-i (max (A (P)), A (0), A (Mi)) 

> «t-t (/ (OPT) + / (0) - (1 + e) / (S’), / (0), / (S c )) 

Note that / 2 (OPT Cl 5) = / (OPT U S' 0 ). Combining inequalities © and © together we get / 2 (OPT n S’) 
/ (OPT) + / (Af) - (1 + e) / (S). Therefore, max^cs A (P) > A (OPT n 5) > / (OPT) + / (M) - 
(1 + e) / (S'). Note also that A (0) = / (S' 0 ) and A (M 2 ) = / (M). Applying inequality © and using the 
monotonicity of on, we have: 

A (A) > on -1 (max A (P), A (0), A (M 2 )) 

> Oi_i (/ (OPT) + / (M) - (1 + e) / (5), / (P c ), / (M)) 

□ 

Back to the proof of claim 12.81 by © we have / (Ti U T 2 ) > / (Ti) + / (T 2 ) — / (5 C ). Applying claim 
12. 121 gives us: 

/(AUT 2 ) > a i _ 1 (/(OPT) + /(0)-(l + e)/(P),/(0),/(5 c )) + 

«i-i (/ (OPT) + / (M) - (1 + e) / (5), / (S c ), / (M)) - / (P c ) 

To prove second part of the composition lemma, we use the following claim: 

Claim 2.13. For every non-negative xopt , £’o i we have: on (xopt, xq,xm) > xm- 

Proof In Step [2]tlic algorithm can choose to output M. Therefore, USM e (/, M, i) > f ( M ). □ 

Using claim 12.131 we know that 

Oi-i (/ (OPT) + / (0) - (1 + e) / (S), 0, / (S c )) > f (S c ) 

Combining it with the first part of the composition lemma gives us: 

/(AUT 2 ) > on-\ (/ (OPT) + / (0) — (1 + e) / (S ), / (0), / (S c )) + 

«i-i (/ (OPT) + / (M) - (1 + e) / (P), / (S c ), / (M)) - / (S c ) 

> cn -1 (/ (OPT) + / (M) - (1 + e)f(S),f (S c ), / (M)) 






2.5.4 Proof of Claim 1231 


Let / be a submodular function such that / (OPT) > xopt > / (0) > 0 and / (M) > xm- We will show 
that: 

USM e (/, M, 1) > max (x M , ^ (/ (OPT) + f (M)) + (Af)) 

Let T\, T 2 be the sets defined by the algorithm when we run USM e (/, M, 1). Using the second part of the 
composition lemma we know that: 


/ (T\ U T 2 ) > a 0 (/ (OPT) + / (M) - (1 + e) / (S) , f (S c ) , / (M)) (10) 

Claim O shows that a 0 (xopt, %m) > 3 (xopt + + ®m) 5 and claim 12.111 gives us: / (S c ) > 

/ (OPT) + / (AT) - 2 (1 + e) / (5). Therefore, 


«o (/ (OPT) + / (M) - (1 + e) / (S ), / (S c ), f (M)) 
> (f (OPT) + 2/ (M) - (! + e )f(S) + f (S c )) 


> 


2/ (OPT) + 3/ (M) - (1 + e) 3/ (S) 


( 11 ) 


From inequalities ( fT7)l ) and (fTTI) it follows that: 


f{TiU t 2)> 2/ (OPT) + 3/ (M) - (1 + e) 3/ (S) 

The value of the output of the algorithm is at least the maximum of f (T\ U T 2 ), f (S), 0 and M. Flence, 
USM t (/, M, 1, > {/ (5) . 2/(OPr) + 3 /(M)-(l + C )3/(5) | 

This is a maximum of two functions, both linear in / (S), one is ascending and one is descending. The min¬ 
imum of a maximum of two such functions is obtained when they intersect, i.e., when / (S) = / (T\ U T 2 ). 
Therefore max (f (S), f (T\ U T 2 )) > g^ (2/ (OPT) + 3/ (M)). Since > g (1 — e) we have: 


max 


(/ (S), f (Tr U T 2 )) > (1 - e) Q • / (OPT) + ^ • / (M)) 


Therefore, 


PSM e (/, M, 1) > max (j (M), L-± (f (OPT) + / (M)) + ^ • / (M)) 

By the definition of a\, it follows that: 

(xopt, 0, x M ) > max ^ x M , (xopt + x M ) + ■ x M 

The proof that o.\(xopt, xq, 0) > max(lqp • xopt + ' x o, xq) is similar, with the roles of M and 0 

switched. 
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